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Abstract 

A broadcast network is a classical network with all source messages collocated at a 
single source node. For broadcast networks, the standard cut-set bounds, which are known 
to be loose in general, are closely related to union as a specific set operation to combine 
the basic cuts of the network. This paper provides a new set of network coding bounds 
for general broadcast networks. These bounds combine the basic cuts of the network via a 
variety of set operations (not just the union) and are established via only the submodularity 
of Shannon entropy. The tightness of these bounds are demonstrated via applications to 
combination networks. 

1 Introduction 

A classical network is a capaciated directed acyclic graph {(y,A), {Ca '■ a G A)), where V and 
A are the node and the arc sets of the graph respectively, and Ca is the link capacity for arc 
a & A. A broadcast network is a classical work for which all source messages are collocated at a 
single source node. 

Consider a general broadcast network with one source node s and K sink nodes tk, k = 
1,. . . ,K (see Figured]). The source node s has access to a collection of independent messages 
W/ = (Wj : i ^ I), where J is a finite index set. The messages intended for the sink node 
tk are given by W/^,, where is a nonempty subset of I. When all messages from W/ are 
unicast messages, i.e., each of them is intended for only one of the sink nodes, it follows from 
the celebrated max-fiow min-cut theorem [1] that routing can achieve the entire capacity region 
of the network. On the other hand, when some of the messages from W/ are multicast messages, 
i.e., they are intended for multiple sink nodes, the capacity region of the network is generally 
unknown except when there is only one multicast message at the source node [HIHIIH] or there 
are only two sink nodes {K = 2) in the network [3| [T0l[T2] . 

In this paper, we are interested in establishing strong network coding bounds for general 
broadcast networks with multiple (multicast) messages and more than two sink nodes {K > 3). 
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HDTRAl-08-1-0010 and by the National Science Foundation under Grant CCF-08-45848. The authors arc with 
the Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, 
USA (email: {salimi, tieliu,cui}@tamu.edu). 
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In particular, we are interested in network coding bounds that rely only on the cut structure 
of the network. The rational behind this particular interest is two- folded. First, cut is a 
well-understood combinatorial structure for networks. Second, the fact that standard cut-set 
bounds [21 Ch. 15.10] are tight for the aforementioned special cases p!l[3|Hll8l- [T0l[T2] suggests 
that cut as a combinatorial structure can be useful for more general broadcast-network coding 
problems as well. 

The starting point of this work is the following simple observation. For each k = 1, . . . , K, 
let be a "basic" cut that separates the source node s from the (single) sink node t^. Then, for 
any nonempty subset U C [K] := {1, . . . , K} the union Ukeu^k is also a cut that separates the 
source node s from the "super" sink node tu, whose intended messages are given by Wu^^g^^,. 
By the standard cut-set bound [U Ch. 15.10], we have 

i?(Ufc6t/4) < C{UkeuAk) (1) 

for any achievable rate tuple Rj := {Ri : i ^ I). Here, R : 2^ ^ IR+ is the rate function that 
corresponds to the rate tuple Rj and is given by 

i?(/'):=5^i?., V/'C/, (2) 
iei' 

and C : 2"^ — )■ is the capacity function of the network where 

CiA'):=J2Ca, VA'CA (3) 

Note that the above observation depends critically on the fact that all messages W/ are 
collocated at the source node s. When the messages are distributed among several source nodes, 
it is well known that the union of several basic cuts may no longer be a cut that separates the 
super source node from the super sink node and hence may not lead to any network coding 
bounds [7]. 

Based on the above discussion, it is clear that for broadcast networks the standard cut-set 
bounds [21 Ch. 15.10] are closely related to union as a specific set operation to combine different 
basic cuts of the network. Therefore, a natural question that one may ask is whether there are 
any other set operations (besides the union) that will also lead to nontrivial network coding 
bounds. 

In this paper, we provide a positive answer to the above question by establishing a new set 
of network coding bounds for general broadcast networks. We term these bounds generalized 
cut-set bounds based on the facts that: 1) they rely only on the cut structure of the network; and 
2) the set operations within the rate and the capacity functions are identical (but not just the 
union any more), both similar to the case of standard cut-set bounds as in (JT]). From the proof 
viewpoint, as we shall see, these bounds are established via only the Shannon-type inequalities. 
It is well known that all Shannon-type inequalities can be derived from the simple fact that 
Shannon entropy as a set function is suhmodular [TU Ch. 14. A]. So, at heart, the generalized 
cut-set bounds are reflections of several new results that we establish on submodular function 
optimization. 

The rest of the paper is organized as follows. In Section |2] we establish several new results on 
submodular function optimization, which we shall use to prove the generalized cut-set bounds. 
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Figure 1: Illustration of a general broadcast network. 

A new set of network coding bounds that relate three basic cuts of the network is provided in 
Section m The proof of these bounds is rather "hands-on" and hence provides a good illustration 
on the essential idea on how to establish the generalized cut-set bounds. In Section HJ a new 
set of network coding bounds that relate arbitrary K basic cuts of the network is provided, 
generalizing the bounds provided in Section [31 In Section [5], the tightness of the generalized cut- 
set bounds is demonstrated via applications to combination networks [11]. Finally, in Section [6] 
we conclude the paper with some remarks. 

2 Modular and Submodular Functions 

Let 5* be a finite ground set. A function / : 2"^ — )■ is said to be submodular if 

f{Si) + f{S2)>f{SiUS2) + f{SinS2), ySi,S2cs, (4) 

and is said to be modular if 

fiS^) + f{S2) = f{S,US2) + fiS^nS2), V5i,52C5. (5) 

More generally, let S^, k = l,...,K,hea. subset of 5*. For any nonempty subset U of [K] 
and any r G [\U\], let 

S^'\U) ■.= U{u'cu:\u'\=r}r\keu'Sk. (6) 

Clearly, we have 

UkeuSk = S^'\U) D 5(2) (f/) D . . . D 5(1^1) (f/) = nkeuSk (7) 
for any nonempty U C [K] and 

S('\U') C S'^'\U) (8) 
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for any c [/' C C \K] and any r G \\U'W. Furthermore, it is known that [6l Th. 2] 

Y^f{S,)>Y.f{S'^^\U)) (9) 

k£U r=l 

if / is a submodular function, and 

\u\ 

fc6(7 r=l 

if / is a modular function. 

Note that the standard submodularity (j9]) relates S^^\U) for different r but a /ixefi t/. To 
establish the generalized cut-set bounds, however, we shall need the following technical results on 
modular and submodular functions that relate S^'^\U) for not only different r but also different 
U. 

Lemma 1. Let r' and J he two integers such that < r' < J < K . We have 

r' J r' J 

E /(5.u5(^'+^)([r]))>5^/(5«([j]))+ J2 /(^^^'"-'^(M)) (11) 

r=l r=r'+l r=l r=r'+l 

if f is a submodular function, and 

r' J r' J 

J2f(Sr)+ /(5.u5(^-'+i)([r])) = ^/(5W([j]))+ fis^'^'^'^m (12) 

r=l r=r'+l r=l r=r'+l 

if f is a modular function. 

Note that when r' = 0, we have S''^''^^'^{[r]) = S^^\[r]) = W^^^Sk ^ 5*^ for any r = 1, . . . , J. 
In this case, the inequality ( ITT]) reduces to the trivial equality 

E/(^^'^(M)) = E/(^^'^(M))- (13) 

r=l r=l 

On the other hand, when r' = J, the inequality (fTT]) reduces to the standard submodularity 

E/(^^)^E/(^^^^(['^]))- (14) 

r=l r=l 

For the general case where < r' < J, a proof of the lemma is provided in Appendix |X1 

Let 5*^ := Sk U Sq for k = 1, . . . ,K. For any nonempty U C [A'] and any r = 1, . . . , |[/| we 
have 

s'(-\u) = U{u'cu:m=r} r\k&' s', (15) 

= ^{U'CU:\U'\=r} HfcGC/' {Sk U 5*0) (16) 
= {^{U'CU:\U'\=r} ^keU' Sk) U 5*0 (17) 

= S^''\U)USo. (18) 
Applying Lemma [1] for S'l^, k = 1, . . . , K , and f|T8|) . we have the following corollary. 
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Corollary 2. Let r' and J be two integers such that < r' < J < K , and let Sq be a subset of 
S. We have 

r' J 

r=l r=r'+l 

r' J 

>5^/(^«([J])U5o)+ Yl fiS^''^'\[r])^So) (19) 

r=l r=r'+l 

if f is a submodular function, and 

t' J 

J2fiSrUSo)+ J2 /(5.U5(^-'+i)([r])U5o) 

r=l r=r'+l 

r' J 

= ^/(5M([J])U^o)+ E fiS^'''^'\[r])^So) (20) 

r=l r=r'+l 

if f is a modular function. 

We shall also need the following lemma, for which a proof is provided in Appendix [Bl 

Lemma 3. Let U and T be two nonempty subsets of [K] . Write, without loss of generality, that 
T = {ti, . . . ,t|T|} where 1 < ti < t2 < ■ ■ ■ < t\T\ < K. Let q and be two integers such that 
l<q<\U\,l<rg<\T\,and 5('?)(f/) C 5(^«)(T). We have 

\T\ 

\T\ 

> J2 ifis'^^'HT)) + fiSu n s^^\u))) + Yl f(s^r n is^'\u) u s^^^+'\{t^, . . . ,t.}))) 

r=l r=rq+l 

(21) 

if f is a submodular function, and 

\T\ 

Yf{S,^)+rJ{S^''\U)) 

r=l 

r \T\ 

= J2 {fis^''\T)) + fis,^ n s^'^\u))) + Y f(Su n is^'\u) u s^^^^'\{t,, . . . , t,}))) 

r=l r=rq+l 

(22) 

if f is a modular function. 

For specific functions, let := (Zj : z G 5) be a collection of jointly distributed random 
variables, and let H{Zs) be the joint (Shannon) entropy of Z5. Then, it is well known [T^ 
Ch. 14.A] that Hz:2^ ^ M+ where 

Hz{S'):=H{Zs:), WS'CS (23) 
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is a suhmodular function. Furthermore, it is straightforward to verify that the rate function 
(for a given rate tuple Ri) and the capacity function C(-), defined in ([2]) and ([3]) respectively, 
are modular functions. 



3 Generalized Cut-Set Bounds Relating Three Basic Cuts 
of the Network 

3.1 Main Result 

Theorem 1. Consider a broadcast network with a collection of independent messages W/ col- 
located at the source node s and K > 3 sink nodes tk, k = 1, . . . , K . For any k = 1, . . . , K , let 
\Nj^ be the intended messages for the sink node t^, and let Aj. be a basic cut that separates the 
source node s from the sink node tk. We have 

R{h u /, u h) + R{h n /,) < C{A, U Aj U Ak) + C{Ai n A,), (24) 
R{ii u ij u h) + R{{ii n ij) u (Ji n h) u (/^ n h)) 

< C{Ai UAiU Ak) + C((A, n A^) U (A, n Ak) U {A, n Afc)), (25) 
R{li u Ij u h) + R{h u Ij) + R{h n Ij n h) 

< C{Ai U Aj U Afc) + C{Ai UAj) + C{Ai n A^- n Afc), (26) 
anc? 2i?(/i U Ij U 4) + R{Ii n n 4) < 2C(Ai U Aj U A^) + C(Ai n A^ n Afc) (27) 

/or any achievable rate tuple Rj and any three distinct integers i, j, and k from [K]. 



Note that the left-hand sides of the generalized cut-set bounds (I2l|) - fl27j) are weighted sum 



rates with integer weights on the rates of the messages from W/^u/.y/fc- Figure [2] illustrates the 
weight distributions for the generalized cut-set bounds (l24l) - (!27|) . 

3.2 Proof of Theorem [1] 

Let (n, {Xa '■ CL G A}) be an admissible code with block length n, where is the message 
transmitted over the arc a. By the independence bound [2| Th 2.6.6] and the link-capacity 
constraints, we have 

Hx{A')<Y,H{X,)<nY,Ca = nC{A'), VA C A. (28) 

For notational simplicity, in this proof we shall assume perfect recovery of the messages at each 
of the sink nodes. It should be clear from the proof that by applying the well-known Fano's 
inequality [2], Th 2.10.1], the results also hold for asymptotically perfect recovery. By the perfect 
recovery requirement, for any nonempty subset U C [K] the collection of the messages Wuj.gj;4 
must be a function of the messages Xu^^^a^ transmitted over the s-tu cut Ufcg[/Afc. We thus 
have 

Hv,{Uk^uIk) < i/x(U,6t/Afc), \/U C [K]. (29) 
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a) Generalized cut set bound (24) 



b) Generalized cut set bound (25) 




c) Generalized cut set bound (26) d) Generalized cut set bound (27) 



Figure 2: The weight distributions for the generahzed cut-set bounds ( !2^ - (l271) . Here, each 
circle represents the set of the messages intended for a particular sink node. The number within 
each separate area indicates the weight for the rates of the messages represented by the area. 



Proof o/ ([24]). Let f/ = {i,j, k} in 1^. Denote by 

IxiAf,A,) := I(XAr,XA^) (30) 

the mutual information between X^^ and X^^ . We have 

ifw(/* U Ij U 4) < Hx{Ai U Aj U Ak) (31) 

= Hx{Ai) + Hx{A,\A,) + Hx{A,\A, U Aj) (32) 

= Hy,{A,) + {Hx{Aj) - Jx(A,; A^)) + (i/x(A) - /x(^; A U A^)) (33) 
= Hy,{Ai) + {Hx{A^) - /x,w(v4i, A,-, /,)) + 

{Hy,{Ak) - IxMAk, 4; Ai U Aj, k U I,)) (34) 
< Hx{Ai) + (i/x(^i) - ^x,w(^i n A„ /, n /,)) + 

{Hx{Ak) - HxMAk n {A, U A,), 4 n (/, U Ij))) (35) 
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where flM|) follows from the fact that: 1) W/^ and W/ are functions of X^. and respectively 
so we have Ix{Ai; Aj) = Ixy\j{Ai, li, Aj, Ij); and 2) W/^. and ^NiiUij are functions of X^^ and 
"^AiUAj respectively so we have Ix{Ak; Ai U Aj) = Jx,w(^A:, h', Ai U Aj, U LI Ij), and ( !35l) follows 
from the fact that 

Jx,w {Ai,I,; Aj , /j ) > Jx,w n Aj- , li n ; A, n Aj ,hnlj) (36) 

= i7x,w(^.nA„/inJ,) (37) 



and 



/x,w(^,4; AuAj,/iU/j) 

> /x,w ( n ( A, u A,- ) , 4 n (/, u J^- ) ; n ( A, u A, ) , 4 n (/, u ) ) (38) 
= HxM^k n (A u Aj), h n (Ji u 4)). (39) 



Note that we trivially have 

Hx,sN{Ai n Aj Jir\I,)>HsN{lir] 4 ) (40) 

and i7x,w(Afcn(AiUA,),4n(/,U/,)) > /Jx(Afcn(AiUA,)). (41) 

Substituting (gO]) and (gl]) into ([35]) gives 

Hyy{k U 4 U 4) + Hy,{I, H /,) < Hx{A,) + /7x(A,) + i/x(^A:) " ^x(Afc H (A, U A,)) (42) 

< ifx(A) + Hx{A,) + i7x(Afc \ (A U Aj)) (43) 

< n (C(A) + C(A,) + C(Afc \ (A U A,))) (44) 
= n {C{A, U A, U At,) + C(A, n A^)) (45) 

where (H3|) follows from the independence bound 

Hx{Ak) < HxiAk n (A, U A^)) + i/x(Afe \ (A, U A,)); (46) 



follows from ([28]) for A' = Aj, Aj, and Ak \ {Ai U Aj); and ([l5]) follows from the fact that 
the capacity function C(-) is a modular function. Substituting 

H^^{I, U U 4) = nR{Ii U 4 U 4) (47) 
and i^w(/^ n Ij) = R{Ii n 4) (48) 



into f[45]) and dividing both sides of the inequality by n complete the proof of f[24]) . □ 
We note here that if we had directly bounded from above the right-hand side of fl3T]) by 
nC{Ai U Aj U Afc) using the independence bound, it would have led to the standard cut-set 
bound 

R{Ii U 4 U 4) < CiAi U Aj U Ak). (49) 

But the use of the independence bound would have implied that all messages transmitted over 
Ai U Aj U Ak are independent, which may not be the case in the presence of multicast messages. 
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Proof of f l25|) . Applying the two-way submodularity (jl]) of the Shannon entropy with Z = (X, W), 

5*1 = (Ai n Aj, li n Ij), and 5*2 = {A^ D {Ai U Aj), 4 fl (/j U Ij)), we have 

ifx,w(A n Aj, k n /,) + i/x,w(A n (A u A,), 4 n (/, u /,)) 

> i?x,w(Ai n n Ak, h n J^- n 4)+ 

Hx,\n{{A, n A,-) u {A, n Afe) u (A,- n A^), (/, n 4) n (/, u 4) n (4 u 4)) (50) 

> Hy^{Ai n A, n Afc) + H^{{k n 4) u (/, n 4) u (4 n 4))- (5i) 

Substituting flSTl) into fl35|) gives 

ifw(/^ u 4 u 4) + i^w((/^ n 4) u (4 n 4) u (4 n h)) 

< H^{Ai) + H^{A^) + i7x(A) - i^x(A. n A, n Ak) (52) 

< ifx(A.) + H^{A,) + iJx(Afe \ {A, n A,)) (53) 

< n {C{Ai) + C(yl,) + C{Ak \ {A, n A,))) (54) 
= n {C{Ai U Aj U Afc) + C((Ai n Aj) U (A n Ak) U (A^- n Afc))) (55) 

where ( 153|) follows from the independence bound 

i^x(Afc) < H^{Ak n (A, n A,)) + H^{Ak \ (A, n A,))- (56) 

(l5il) follows from (I2H]) for A' = Aj, Aj, and A^ \ (A.^ n Aj); and ([55]) follows from the fact that 
the capacity function C(-) is a modular function. Substituting (1471) and 

//w((/» n 4) u (J, n 4) u (4 n 4)) = nR{{k n 4) u (J, n 4) u (4 n 4)) (57) 

into (!55|) and dividing both sides of the inequality by n complete the proof of (125|) . □ 
Proof of (!26|) . By the symmetry among i, j, and /c in (135|) . we have 

ifw(/^ U 4 U 4) < Hy,{A,) + (i/x(Afe) - i/x,w(Ai n Ak, k n 4)) + 

(ifx(A,) - ifx,w(A,- n (A U Afe), 4 n {h u 4))) • (58) 

Also note that 

H^Nih U 4) < i/x(A U A,) (59) 

= i7x(A,) + i/x(A,|A,) (60) 

= /7x(A) + (i/x(A,) - 4(A; A,)) (61) 

= H^{A,) + (i/x(A,) - 4,w(A„ Aj, 4)) (62) 

< ifx(A,) + (ifx(A,) - ifx,w(A, n A,, /, n 4)) . (63) 

Adding fl58|) and fl63|) gives 

ifw(/^ u 4 U 4) + H^{k u 4) 

< 2i7x(Ai) + 2H^{A,) + i7x(Afc) - //x,w(Ai n A„ J, n 4)- 

ifx,w(A, n Ak, li n 4) - i^x,w(A, n (A, u A,.), 4 n (/, u 4))- (64) 
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Applying the two-way submodularity (jl]) of the Shannon entropy with Z = (X, W), 5*1 = [Ai fl 

Aj, li n Ij), and 5*2 = {A^ fl A/^, li fl Ik), we have 

Hx,w{A, n Aj, I, nij) + HxM^i n Afc, J, n 4) 

> i/x,w(A, n A,- n Afc, /, n /, n 4) + i/x,w(A n {Aj u A^), h n (/,• u 4)) (65) 

> Hs^ih n 4 n 4) + /Jx(A^ n {A, u A^)). (66) 

Note that we trivially have 

i/x,w(Ai n {A, U Afc), 4 n (Ji u 4)) > H^^Aj n (A, U Au)). (67) 
Substituting f l66l) and fl67|) into fl6^ . we have 

i7w(/i u 4 u 4) + H^^ih u 4) + H^{ii n 4 n 4) 

< 2i7x(A) + 2i/x(v4,) + ifx(Afe) - i/x(A n (A, U Ak)) - Hy,{A, n (A U Afc)) (68) 

< Hy,iA,) + ifx(^,) + i^x(A) + H^iA, \ (A, U Ak)) + i/x(^, \ (^. U A^)) (69) 

< n (CiA,) + C(A,) + C(A,) + CiAi \ (A^ U A^)) + C(A, \ (A, U A^))) (70) 
= n {C{Ai U U Afc) + C{Ai U Aj-) + C{Ai n A^ n Afc)) (71) 

where fl5^ follows from the independence bounds 

i/x(A) < i^x(A n {A, U Afe)) + ifx(A \ {A, U Ak)) (72) 
and i7x(Aj) < ifx(Aj n (A, U A)) + Hy,{A^ \ {A, U A^)); (73) 

(170]) follows from ^ for A = A^, Aj, Ak, Ai \ {Aj U Ak), and A^ \ {Ai U A^); and ([71]) follows 
from the fact that the capacity function C(-) is a modular function. Substituting (ITT]) . 

i/w(/iU4) =n4(/,U4), (74) 

and i^'w(/i n 4 n 4) = n4(/i H 4 n 4) (75) 

into fl7T]) and dividing both sides of the inequality by n complete the proof of fl2B]l . □ 
Proo/ o/ ([27]). Adding ([35]) and ([SS]), we have 

2Hw{I, U 4 U 4) < 2Hx{Ai) + 2Hx{A,) + 2Hx{Ak) - ifx,w(A n Aj, /, n 4)- 

i7x,w(Ai n Afc, li n 4) - i^x,w(Aj n {Ai u A,,), 4 n {h u 4))- 
i^x,w(Afc n {Ai u Aj), 4 n (/, u 4)). (76) 

Note that we trivially have 

HxM^k n {Ai U Aj), 4 n {li U 4)) > Hx{Ak n (A^ U A,)). (77) 
Substituting ([HE]), ([SB > and ([77]) into ([TB]), we have 

2i7w(/i u 4 u 4) + i^w(/i n 4 n 4) 

< 2i7x(A) + 2i7x(Aj) + 2i7x(Afc) - i/x(A n {A, U A^))- 

i/x(Aj n (A, U Afc)) - /7x(Afc n (A U Aj)) (78) 

< i/x(A,) + i/x(Aj) + //x(Afc) + Hx{Ai \ (Aj U Afc))+ 

Hx{A, \ {A, U Afc)) + Hx{Ak \ (A U Aj)) (79) 

< n (C(A,) + C(Aj) + C{Ak) + C(A, \ (Aj U Afc))+ 

C(Aj \ (A, U Afc)) + C{Ak \ (A, U Aj))) (80) 
= n {2C{Ai U Aj U Afc) + C(A n Aj n A^)) (81) 
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where (179|) follows from the independence bounds fH6|) . fl72|) . and fl73l) : flHOj) follows from fl28|) 
for N = Ai, Aj, Ak, Ai \ {Aj U Ak), Aj \ {Ai U A-) and Ak \ (A U Aj); and ([81]) follows from the 
fact that the capacity function C(-) is a modular function. Substituting ( l47l) and ( l75l) into ( ISTI) 
and dividing both sides of the inequality by n complete the proof of ( 127|) . □ 
We have thus completed the proof of Theorem [H 

4 Generalized Cut-Set Bounds Relating K Basic Cuts of 
the Network 

4.1 Main Results 

Theorem 2. Consider a broadcast network with a collection of independent messages \Nj col- 
located at the source node s and K > 3 sink nodes t^, k = 1, . . . ,K . For any k = 1, . . . , K , let 
W/^ be the intended messages for the sink node t^, and let Aj. be a basic cut that separates the 
source node s from the sink node t^. Let G, U and T be nonempty subsets of [K] such that 

A'^^\G)^ A^^\U). (82) 

Let Q be a subset of {2, ... , \U\}, and let (r^ : g G Q) be a sequence of integers from [\T\] and 
such that 

A^''\U) C A^"'\T) and /(«)([/) C /('^'')(T), Vg G Q. (83) 

We have 

i?(/«(G))+ Yl Rii^''\u)) o^a^^-^T)) 

re{2,...,\U\}\Q q&Q r=l 

< C{A^'\G)) + C'(A«([/)) (84) 

T(i{2,...,\U\}\Q q£Q r=l 

for any achievable rate tuple Rj, where 

r 0, ifreQ 

OiQ{q,r)=< n{peQ:p<r}(P-l) n{peQ:r<p<r,} P ^ d Q (^5) 

for any q ^ Q and r G [r^] . 

Note that the generalized cut-set bound fl8^ involves a number of parameters: G, U, T, Q, 
and {vq : q & Q). Specifying these parameters to certain choices will lead to potentially weaker 
but more applicable generalized cut-set bounds. More specifically, let G = U = T and Vg = q — 1 
for any q & Q. By the ordering in ([7]), the condition in (!83|) is satisfied (the condition in (182|) 
holds trivially with an equality). Thus, by Theorem |2] we have 

q-l 

J2 i?(/(^)(f/))+5^5^«Q(g,r)i?(J«(f/)) 

rel\U\]\Q q£Q r=l 

< C(AW(f/)) + EE"«(^'^)^(^^''^(f^)) (86) 

re[\U\]\Q q&Q r=l 
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for any achievable rate tuple Rj, where 



0, iireQ 

OiQ{Q,r)=^ n{p6Q:p<r-}(P-l)nfasQ:r<p<<,-l}P \f r d Q ^^^^^ 

for any q E Q and r G [g — 1]. A proper simplification of f l86|) leads to the following corollary. 
See Appendix O for the details of the simplification procedure. 

Corollary 4. Consider a broadcast network with a collection of independent messages W/ col- 
located at the source node s and K > 3 sink nodes t^, k = 1, . . . , K . For any k = 1, . . . , K , let 
W/j. be the intended messages for the sink node t^., and let be a basic cut that separates the 
source node s from the sink node tk- Let U be a nonempty subset of [K], and let Q be a subset 
of {2,...,\U\}. We have 

\u\ \u\ 

5^/3Q(r)i?(J«(t/)) < 5^/3g(r)C(A«(f/)) (88) 

r=l r=l 

for any achievable rate tuple Rj, where f^q^r) = 1 for any r G [\U\] if Q = and 

for any r G [\U\] ifQ^^. 

The generalized cut-set bound flHHjl can be further specified by letting Q = {2, . . . ,m} for 
m = 1, . . . ,\U\ (note that Q = ^ when m = 1). For this particular choice of Q, we have 

ml, r = 1 

0, r = 2, ...,m (90) 
(m — 1)!, r = m + 1, . . . ,\U\. 

Substituting (pO!) into (188|) immediately leads to the following corollary. 

Corollary 5. Consider a broadcast network with a collection of independent messages W/ col- 
located at the source node s and K > 3 sink nodes tk, k = 1, . . . , K . For any k = 1, . . . , K , let 
W/j. be the intended messages for the sink node tk, and let be a basic cut that separates the 
source node s from the sink node tk ■ Let U be a nonempty subset of [K] . We have 

\u\ \u\ 
mR{I^^\U))+ R{I^'\U)) <mC{A^^\U))+ ^ C{A^'\U)) (91) 

r=m+l r=m+l 

for any achievable rate tuple Rj and any m = 1, . . . , |f/| . 

Now, the generalized cut-set bound ( 1271) can be recovered from Corollary [5] by setting U = 
{1, 2, 3} and m = 2 in (I9T]) : the generalized cut-set bound (!25|) can be recovered from CoroUaryH] 
by setting U = {1, 2, 3} and Q = {3} such that 
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the generalized cut-set bound flMl) can be recovered from Theorem |2] by setting G = {i,j,k}, 
U = {i,j} (so A'^^\G) D A^^\U)) and (5 = 0; and finally, the generalized cut-set bound fl26|) can 
be recovered from Theorem [2]by setting G = U = {i,j,k} (so A^-^\G) = A^^\U)), T = {i,j}, 
Q = {2}, and r2 = 1 such that 

A(2)([/) = {A, n A,) u (A n Ak) u (A, n A^) c a u A, = A(^2)(T), 

/(2)([/) = ih n /,) u ih n 4) u (J, n 4) c u i, = &-\u), ^^""^ 

and q:q(2, 1) = 1. 

4.2 Proof of Theorem [2 

Let (n, {Xa : a G A}) be an admissible code with block length n, where is the message 
transmitted over the arc a. Similar to the proof of Theorem [H we shall assume perfect recovery 
of the messages at each of the sink nodes. As such, for any nonempty subset U C [K] the 
messages y\lukeuh i^ust be functions of the messages y^uteu^k transmitted over the s-tu cut 

Let us first consider the case where (5 = 0- Note that 
H^{I^'\G)) 

< i/x(AW(G)) (94) 

< //x(AW(f/)) + Hy,{A^'\G) \ A^'\U)) (95) 

= i/x,w(A«(t^), I'-'KU)) + H^{A^'\G) \ A«(?7)) (96) 

\u\ 

< J2HxMAk,h) -J2H^MA^'^\U)J^^\U)) + Hy,{A('\G)\A('\U)) (97) 

keU r=2 

\u\ 

= ^ifx(Afc) -J2HxM^^''\U),I^^\U))+Hy,{A('\G)\A('\U)) (98) 

fcef/ r=2 

<n ('5^C(A,) + C(AW(G)\A«(f^))) -Y^HxMA^''\U),&\U)) (99) 

VfcGf/ / r=2 

^C(AW(f/)) + C(A«(G)\A«(f/)) -J2Hw{I^''\U)) (100) 

r=l / r=2 

\U\ \ \U\ 

C(A«(G)) + ^C(A«(t/)) -^i7x,w(AM(f^),^^'nf^)) (101) 

r=2 / r=2 

where and (p6|) follow from the fact that the messages Wj-{i)(^) are functions of X^(i)(^); 
(p5|) follows from the independence bound on entropy; (p7|) follows from the standard multiway 
submodularity (jH]); (1981) follows from the fact that the messages W/^, are functions of X^^. so we 
have Hxy\i{Ak,Ik) = ifx(^fc) for any k E U] follows from the link capacity constraints; 
fllOOl) follows from the fact that the capacity function C(-) is a modular function so we have 



n 



n 
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'^keu^(^k) = X]i=i ^(^''''''(^))! (110 II) follows from the fact that the capacity function 
C(-) is a modular function and the assumption fl82|) so we have C{A^^\G)) = C{A^^\U)) + 
C(A(^)(G') \ A(^)(f/)). Rearranging the terms in (fTOTl) gives 



r=2 \ r=2 



Further note that 



ifw(/(i)(G')) = n/2(/«(G)) (103) 
and H,,,^{A^'\U),&\U))>H,,{&\U))=nR{&\U)), Vr = 2, . . . , |f/|. (104) 

Substituting (11031) and (11041) into (llOip and dividing both sides of the inequality by n, we have 

m \u\ 

i?(/(i) (G)) + J] i?(/^'^ (f/)) < C(A(i) (G)) + ^ C(AM (U)) (105) 

for any achievable rate tuple Rj. This completes the proof of (184|) for Q = 0. 

Next, assume that Q ^ ^. Write, without loss of generality, that Q = {qi, . . . , q\Q\} where 

2<gi<g2<---<g|Q|<|f/|. (106) 
By Lemma [31 for any two integers q' and r^/ such that I < q' < \U\, 1 < r^/ < |T|, A^'^'\U) C 



14 



v4(v)(T), and /("')([/) C I(w\t) we have 

r=l 

\T\ V 

< 5^/7x,w(A.,/tJ - 5^i/x,w(A. n n/^-^'Ht/))- 

|T| 

^ i/x,w(^, n (^('''nf/) u A(v+^)({ti, . . . , t,})), 

/,,n(/('^')(f/)u/(v+i)({t,,...,t,}))) (107) 

|T| 

J2 i/x(A,n(A(''')(t/)uA(v+i)({ti,...,tj))) (108) 

r'=ry+l 

V \T\ 

<Y,Hx{A^\A^'''\U))+ J2 H,,{A^\{A^'^'\U)UA^^^'^'\{t„...,tr})) (109) 

r=l r=r^/+l 

<n{Y,C{AAA'^'''\U))+ C{A,.\{A^'^'\U)UA^^^'+'\{h,...,U}))\ (110) 

r=l r=rg/+l / 

|T| V 

Ec'(AJ-5^C(A,,nA('^')(t/))- 

r=l r=l 

E C(A,^n(A('^')(t/)uA(v+i)({t,,...,t,}))) (111) 

r=rg/+l / 

J]c(AW(r))-vC(A(''')(t/)) (112) 



n 



n 



,r=l 



where f llOSp follows from the fact that the messages W/^^ are functions of X^i^^ so we have 
Hxy\i{At^, It^) = Hx{At^) for any r G and the trivial inequalities 

HxMAunA^'^'\U),It.nl^'^'\U)) > Hy,iA^nA^'^'\U)), Vr e [v] (113) 
and i/x,w(A. n (A(«')(f/) U A(V+i)({ti, . . H (/^^'^t^) U /(V+i)({t„ . . . ,t,}))) 

> i7x(A. n (A(^')(f/) u A(v+i)({t„ . . . ,tj))); (114) 

(11091) follows from the independence bound on entropy; (IllOp follows from the link-capacity 
constraints; and (1 11 II) and (11121) follow from the fact that the capacity function C(-) is a modular 
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function. Letting r^/ = q' = qj and U = T in flll2p . we have 

J] i7x,w(AM(T), /M(T))-g,i7x,w(A(*H^), ^^"^H^)) 

<n(f2C{A^'\T))-q,C{A^^^\T)) 



r=l 



,r=l 



Let 



nQ{q,r) := JJ (p - 1) JJ p 

{p€Q:p<r} {peQ:r<p<rq} 

and dQ(g) := H ~ ^) 

{pgQ:p<r,} 



(115) 

(116) 
(117) 



for any q E Q and r G [r^], and let Qi := {q E Q : q < Vg.}. Note that nQ{q,r) and (iQ(g) 
are always positive. Multiplying both sides of flllSp by nQ{qi,qj) and then summing over all 
qj G Qi, we have 



\Qi\ 



E E ^x.w(^^''Ht), /(^Ht)) - g,i/x,w(Afe)(T), /(''^)(T)) 



i=i 



,r=l 



.1 



j=l \r=l 



(118) 



Note that 



\Qi\ Qj 1\Qi\ I \Qi\ 

En(g.,g,)E^x,w(AM(T),/('-)(T)) = E E ^(^-^^•) I ^x,w(A«(T),jM(r)) (119) 

i=l ''=1 ^=1 \j=jir) 



where 



j[r) := < 



1, for < r < gi 

2, for qi < r < q2 

^ \Qil for g|Q,|-i < r < gjQ^j. 



(120) 



We can thus rewrite (11181) as 



91Q,I / \Qr\ 

E E ^fe,g,)-™Q(g„r)l|,,Q^} I H^,^{A^^\T)J^^\T)) 

(9|Qil / \Q^\ 
E E ^(?-?.)-™Qfe'Ol{reQ.} I C{A^^\T) 
^■=1 \i=i('') 



(121) 
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Furthermore, letting q' = qi and r^/ = r^- in flll2p and multiplying both sides of the inequality 

by dq^qi), we have 

'f^dQ{q,)Hy,^^{A^^\T)J^^\T))-TMQ^)Hx,^N{A'^''^^ 

r=l 

< n (^^dQiq.)C{A^^\T))-rMQ^)CiA^''\U))^ . (122) 
Adding ffT2B and (fT22D gives 

< ^ (X;r2'Q(g„r)C(AM(T)) - rM<l^)C{A'•^'\U))] (123) 



r=l 



,r=l 



where 

^' ^q.^ r) = I ^i=iM ~ '^)l{rGQO + if 1 < r < q\Q^\ ^^24) 

^ " \ dgiqi), if giQ^i < r < r.^^. 

By ()120l) . when qm-i < f < q-m for some m = 1, . . . ,\Qi\ (go := for convenience), we have 
j{r) = m and hence 

\Qi\ m 

nqiqu qj) = riqiqi, qj) (125) 

j=j{r) j=m 

\Q^\ fj-l \Q^\ \ 

= E n(* - 1) n (126) 

j=m y=l l=j+l J 

\Q^\ \Q^\ 3 m \ 

= E n(^' - 1) n^' - n(^' - 1) n (12?) 

j=m \l=l l=j 1=1 l=j+l J 

\Q^\ \Q^\ \ A-i IQ^I \ 

= E lite - i)n« - E IK* - 1)11* (128) 

j=m \l=l l=j J j=m+l \l=l l=j J 

m-1 \Qi\ \Qi\ 

= n(^'-i)n^'-n(^'-i) (129) 

1=1 l=m 1=1 

m—1 \Qi\ 

1=1 l=m 
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Therefore, when r = for some m G we have 

\Qi\ m—1 \Qi\ m—1 \Qi\ 

^nQ{qi,qj)-qmnQ{qi,q„,) + dQ{qi)=Y[{<li-^)Yl(li-(lmYl{qi-'i-) JJ Qi (131) 

j=m 1=1 l=m 1=1 l=m+l 

= 0; (132) 
when qm~i < r < qm for some m G we have 

\Qi\ m-l \Qi\ 

nqiqi, qj) + dQ{qi) = Yl{<li-^)Yl (^33) 

j=m 1=1 l=m 

= rgMqi)aQ{qi,r); (134) 
and when q\Q.\ < r < r^- we have C(Q{qi, r) = l/r^. and hence 

dQiQi) =rg,dQ{qi)aQ{qi,r). (135) 
Combining fll32p . fll34p . and fll35p . we conclude that 

n'Q{qi,r) = rg^dQ{qi)aQ{qi,r), Vr G [r^J. (136) 
Dividing both sides of fll23p by rq^d{qi) and then summing over all qi E Q, we have 

E«Q(g, r)H^MA^'HT), /M(T)) - J2 Hy,MA^'\U), /(")([/)) 

q(zQ r=l qeQ 

^ ^ ( EE"q('?'^)C'(^^'^^(^)) - ) • (137) 

\qeQ r=l q£Q J 

Adding (fT02D and (fT37l) . we have 

i/w(/('HG')) + 5^ ifx,w(AM(t/),/M(t/)) + J]f;aQ(g,r)i7x,w(AM(T),/M(T)) 

re{2,...,|C/|}\Q gGQ r=l 

<n|c(AW(G))+ 5^ C(A«(f/)) + 5^X]"Q(^'^)^(^^''^(^))) • (138) 

\ re{2,...,\U\}\Q geQ r=l J 

Note that we trivially have 

ifx,w(AM(^), I^'^T)) > H^{&\T)) = ni?(/M(2^)), Vg G Q and r G [r,]. (139) 

Substituting fll03p . fll04p . and fll39p into fll38p and dividing both sides of the inequality by n 
complete the proof of flMl) for Q 7^ 0. 

We have thus completed the proof of Theorem [21 
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(W{i}, W{2} , W{3}, W{i,2} , W{i,3}, W{2,3} , W{i,2,3}; 




(W{i},W{i,2},W{i,3},W{i,2,3}) 



(W{3},W{i,3},W{2,3},W{i,2,3}; 



(W{2},W{i,2},W{2,3},W{i,2,3}) 

Figure 3: Illustration of the general combination network with K = ?> sink nodes and a complete 
message set. 



5 Applications to Combination Networks 

To demonstrate the tightness of the generalized cut-set bounds, let us consider a special class of 
broadcast networks known as combination networks [TT]. A combination network is a broadcast 
network that consists of three layers of nodes (see Figure |3] for an illustration). The top layer 
consists of a single source node s, and the bottom layer consists of K sink nodes tk, k = 1, . . . , K. 
The middle layer consists of 2^ — 1 intermediate nodes, each connecting to the source node s and 
a nonempty subset of sink nodes. While the links from the source node s to the intermediate 
nodes may have finite capacity, the links from the intermediate nodes to the sink nodes are all 
assumed to have infinite capacity. More specifically, denote by vu the intermediate node that 
connects to the nonempty subset U of sink nodes and au the link that connects the source node s 
to the intermediate node vu. The link capacity for au is denoted by Cu- Note that when Cu = 0, 
the intermediate node vu can be effectively removed from the network. By construction, the 
only interesting combinatorial structure for combination networks is cut. Therefore, combination 
networks provide an ideal set of problems to understand the strength and the limitations of the 
generalized cut-set bounds. 

In Figure [3] we illustrate a general combination network with K = 3 sink nodes and a general 
message set that consists of a total of seven independent messages 

(W{i}, W|2}, W{3}, W{i,2}, W{i,3|, W{2,3}, W{i,2,3}), 
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where the message Wf/, U C {1,2,3}, is intended for all sink nodes tk, k eU. This network 
coding problem was first introduced and solved by Grokop and Tse [5] in the context of charac- 
terizing the latency capacity region |13] of the general broadcast channel with three receivers. 
More specifically, it was shown in [5] that the capacity region of the network is given by the set 
of nonnegative rate tuples 



R{2}, -R{3}, -R{1,2}, -R{2,3}, -R{1,3}, -R{1,2,3}) 



satisfying 



-R{1}+-R{1,2} + -R{1,3} + -R{1,2,3} < C{1} + C'{1,2} + C'{1,3} + C*{1,2,3}, (140) 
i?{2}+-R{l,2} + -R{2,3} + -R{1,2,3} < C*{2} + ^'{1,2} + C'{2,3} + C'{1,2,3}5 (141) 
-R{3}+-R{1,3} + -R{2,3} + -R{1,2,3} < Q3} + Ql.S} + C'{2,3} + C*{1,2,3}, (142) 
+ -R{2}+-R{1,2} + -R{2,3} + -R{1,3} + -R{1,2,3} 

— Ql} + Q2} + C'{1,2} + C'{2,3} + C'{1,3} + C'{1,2,3}5 (143) 
R{2} + -R{3}+-R{1,2} + -R{2,3} + -R{1,3} + -R{1,2,3} 

< C'{2} + C'jS} + C'{1,2} + C*{2,3} + C'{1,3} + C'{1,2,3}, (144) 
-R{1} + -R{3}+-R{1,2} + -R{2,3} + -R{1,3} + -R{1,2,3} 

— Ql} + + C'{1,2} + C'{2,3} + C'{1,3} + C'{1,2,3}5 (145) 
-R{1} + R{2} + -R{3}+-R{1,2} + -R{2,3} + -^{1,3} + -^{1,2,3} 

< C{1} + C{2} + C{3} + C'{1,2} + (^{2, 3} + Ql.S} + C'{1,2,3}, (146) 
-R{1} + R[2} + -R{3}+2-R{l,2} + -R{2,3} + -R{1,3} + 2-R{i,2,3} 

— ^{1} + ^{2} + C'{3} + 2C{i^2} + C'{2,3} + C'{1,3} + 2C{i_2,3}, (147) 
-R{1} + R[2} + -R{3}+-R{1,2} + 2-R{2,3} + -^{1,3} + 2-R{i,2,3} 

< C{i} + C{2} + C*{3} + C{i,2} + 2C*{2,3} + C'{i,3} + 2C{i,2,3}, (148) 

-R{1} + R[2} + -R{3}+-R{1,2} + -R{2,3} + 2-R{l,3} + 2-R{i,2,3} 

— Ql} + Q2} + (^{3} + C'{1,2} + C'{2,3} + 2C{i^3} + 2C{i_2,3}5 (149) 
+ i?{2} + -R{3}+2i?{i_2} + 2-R{2,3} + 2-R{l,3} + 2i?{i_2,3} 

— ^{1} + ^{2} + C'{3} + 2C{i^2} + 2C{2,3} + 2C{i_3} + 2C{i_2,3}5 (150) 
R{i} + 2-R{2} + 2i?|3}+2i?{i_2} + 2-R{2,3} + 2-R{i,3} + 3-R{i_2,3} 

— Qi} + 2C{2} + 2C{3} + 2C{i^2} + 2C{2,3} + 2C{i_3} + 3C{i^2,3}5 (151) 
2i?{i} + R{2} + 2i?{3}+2i?{i_2} + 2-R{2,3} + 2-R{i,3} + 3-R{i_2,3} 

< 2C{i} + 2C{2} + C{3} + 2C{i,2} + 2C{2,3} + 2C{i,3} + 3C{i,2,3}, (152) 
2_R{i} + 2i?{2} + -R{3}+2_Rji_2} + 2-R{2,3} + 2-R{i,3} + 3-R{i_2,3} 

< 2C{i} + 2C{2} + C{3} + 2C{i,2} + 2C{2,3} + 2C{i,3} + 3C{i,2,3}, (153) 
2_R{i} + 2_R{2} + 2i?{3}+2_R{i_2} + 2-R{2,3} + 2-R{i,3} + 3-R{i_2,3} 

< 2C{i} + 2C{2} + 2C{3} + 2C{i^2} + 2C{2,3} + 2C{i^3} + 3C{i_2,3}- 

(154) 

From the converse viewpoint, the inequalities fll40p - fll46l) follow directly from the standard cut- 
set bounds ([1]) by considering the following three basic cuts: Ai = {a{i}, a{i^2}5 0{i^3}, a{i^2,3}}5 
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^2 = {a{2 },a{i,2},a{2,3},a{i,2,3}}, and ^3 = {a{3}, a{2,3}, 0(1,3}, a{i,2,3}}- For the inequalities 
f ll47p - fll54p . the proof provided in |5] was problem-specific and appears to be rather hand- 
crafted. With the generalized cut-set bounds now in place, however, it is clear that the in- 
equalities f ll47p -( |T49l) follow directly from ( l24l) : the inequality f ll50p follows directly from ( 125|) : 
the inequalities f ll5ip -( |T53|) follow directly from ( 126|) : and the inequality fll54p follows directly 
from (!27l) . Thus, the standard and the generalized cut-set bounds together provide an exact 
characterization of the capacity region of the general combination network with three sink nodes 
and a complete message set. 

Next, let us consider the general combination network with K sink nodes and symmetrical 
link capacity constraints [T3] : 

Cu = Ciu\, Vf/ C [K] (155) 

i.e., the link-capacity constraint for arc au depends on the subset U only via its cardinality. 
Assume that the source s has access to a set of + 1 independent messages (Wi, . . . , W^^, Wq), 
where W^, k = l,...,K,isa private message intended only for the sink node tk, and Wq is a 
common message intended for all K sink nodes in the network. For this communication scenario, 
note that Aj. = {au : U 3 k} is a basic cut that separates the source node s from the sink node 
tk for each k = 1, . . . , K . Applying Corollary |S] with U = [K], we have 

KRo + mRs,<mJ2[ ^ ) Cr + E E( ^ ) (1^6) 

r=l ^ ^ r=m+l j=r ^ ^ 

= "^E( E ir-m)(^]Cr (157) 

r=l ^ ^ r=m+l ^ ^ 

for any achievable rate tuple (Rq, Ri, . . . , Rk) and any m = 1, . . . , i^, where Rsp = J2k=i is 
the sum of the private rates. It is clear that the outer bound given by the inequality f ll57p for 
m = 1, . . . ,K has exactly K + 1 corner points: 




The achievability of these corner points was proved in [13]. Therefore, the generalized cut-set 
bounds also provide a tight characterization of the common-v.s. -sum-private capacity region of 
the general symmetrical combination network. 

Finally, let us make an explicit comparison between the common- v. s.-sum-private capacity 
region of the general symmetrical combination network and the outer region given by just the 
standard cut-set bounds for the case oi K = 3 sink nodes. For K = 3, the common- v. s.-sum- 
private capacity region of the network is given by all nonnegative {Rq, Rgp) pairs satisfying 

SRo + Rsp < 3C1 + 6C2 + 3C3, 
3Ro + 2Rsp < 6C1 + 6C2 + 3C3, (158) 
and Ro + Rsp < 3C1 + 3C2 + C3. 
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Ca C2 + C3 2C2 + C3 Ci + 2C2 + C3 

Figure 4: Capacity v.s. cut-set outer regions for K = ?> sinks. The boundary of the capacity 
region is illustrated by solid lines, while the boundary of the cut-set outer region is illustrated 
by dashed lines. 

The standard cut-set bounds, in this case, are given by 





Rq 


+ Ri 


< 


C, + 2C2 + Cs, 




Ro 


+ R2 


< 


Ci + 2C2 + Cs, 




Ro 


+ R3 


< 


Ci + 2C2 + C3, 


Ro 


+ Ri 


+ R2 


< 


2Ci + 3C2 + C3, 


Rq 


+ Ri 


+ R3 


< 


2Ci + 3C2 + C3, 


Rq 


+ R3 


+ R2 


< 


2Ci + 3C2 + C3, 


Rq + Ri 


+ R2 


+ R3 


< 


2Ci + 3C2 + C3. 



(159) 



Substituting Ri = Rsp — R2 — R3 into (11591) and using Fourier- Motzkin elimination to eliminate 
i?2 and i?3 from the inequalities in (11591) . we may explicitly write the outer region given by just 
the standard cut-set bounds as the nonnegative (i?o,-Rsp) pairs satisfying 

SRo + Rsp < 3C1 + 6C2 + 3C3, 

2Ro + Rsp < 3C1 + 5C2 + 2C3, (160) 
and Ro + Rsp < 3C1 + 3C2 + C3. 

In Figure H] we illustrate the rate regions constrained by (11581) and (11601) , respectively. Clearly, 
even for the case with only K = 3 sink nodes, the standard cut-set bounds alone are not tight, 
while the generalized cut-set bounds provide a precise characterization of the common-v.s. -sum- 
private capacity region. 
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6 Concluding Remarks 



The paper considered the problem of coding over broadcast networks with multiple (multicast) 
messages and more than two sink nodes. The standard cut-set bounds, which are known to be 
loose in general, are closely related to union as a specific set operation to combine different basic 
cuts of the network. A new set of network coding bounds (termed as generalized cut-set bounds), 
which relate the basic cuts of the network via a variety of set operations (not just the union), were 
established via the submodularity of the Shannon entropy. It was shown that the generalized 
cut-set bounds (together with the standard cut-set bounds) provide a precise characterization of 
the capacity region of the general combination network with three sink nodes and the common- 
v.s. -sum-private capacity region of the general symmetrical combination network (with arbitrary 
number of sink nodes). 

Our ongoing work focuses primarily on further understanding the strength and the limitations 
of the generalized cut-set bounds established in this paper. In particular, it would be interesting 
to see whether the generalized cut-set bounds are tight for the symmetrical capacity region of 
the general symmetrical combination network, which was recently characterized by Tian [13]. 



A Proof of Lemma [T] 

Fix two integers r' and J such that < r' < J < K. Let 

0, for r = 1, . . . , r' 

forr = r' + l,..., J, 



(161) 



and let Gr := Sr U Tr for r = 1, . . . , J. By the standard multiway submodularity ([9]) and 
modularity (ITOl) we have 



r' J J J 

E /(5.US(^-'+^)([r])) = 5^/(a)>5^/(GM([J])) (162) 

r=l r=r'+l r=l r=l 

if / is a submodular function, and 

E/(5.)+ /(5.U5('-'+i)([r])) = X]/(a) = X^/(G(^n[^])) (163) 

r=l r=r'+l r=l r=l 

if / is a modular function. Next, we shall show that 

rir)(\m-S '5W([J]), forr = l,...,r' 

U^JJ s^'-'+^^lJ ~r + r' + 1]), forr = r' + l,..., J. ^ ' 

We shall consider the following two cases separately. 

Case 1: r e [r']. Note that Sr C Gr for any r G [J], so we have S^'^^lJ]) C G'^''\[J]) for any 
re [J]. On the other hand, since C 5("'+i)([J]) for all r G [J], we have C 5, U 5('''+i)([J]) 
and hence G(^')([J]) C ^('■^([J]) U 5('''+i)([J]) for all r E [J]. Since ^^([J]) D 5('''+i)([J]) for all 
r e [r'], we have G'('')([J]) C ^('■^([J]) for all r G [r']. We thus conclude that G'^'mJ]) = ^('■^([J]) 
for all r G [r']. 

Case 2: r G {r' -|- 1, . . . , J}. For this case, we have the following fact. 
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Fact 1. For any r G {r' + 1, . . . , J}, we have 

G^'HlJ]) = ur=t'^'^'^ {S^"^-'\[J - r + m - 1]) n T,_,+^) . (165) 

Proof. Fix r G {r' + 1, . . . , J}. By definition, 

G^'\[J]) = U{uc[j]:\u\=r} nkeu Gk. (166) 

Fix U C [J] such that \U\ = r. We have 

Hk^uGk = n^eu {Sk U Tfc) (167) 

= ^U'cu {{nkeU'Sk) n (nfcet7\f;,Tfe)) (168) 

= i^u'cu ((n ))uinkeuSk) (169) 

where A;(f/') is the smallest integer in U \ U', and (11691) follows from the fact that 

Ti C Ts C . . . C Tj. (170) 

Write, without loss of generality, that U = {ui, . . . , Ur} where 1 < ui < U2 < ■ ■ ■ < Ur < J . Fix 
k{U') = Um for some m G [r]. Then we must have U' ^ . . . for any such U' . We 

thus have from (11691) that 

n,^uG, = {u:^^, {{nTJi'sj n u (n^^^.J . (i7i) 

The right-hand side of (I17ip can be further simplified based on the following two observations. 
First, for any r G {r' + 1, . . . , J} we have > r > r' + 1 and hence 

Tu^ = s^^-'+'\[ur]) D ntfs^, D n^s^, (172) 

We thus have 

nUS^,c{nZlsjnT^^ (173) 

and hence 

n,^uG, = u:,^, {inz\'sj n r„^) . (174) 

Second, since Ur'+2 > r' + 2, we have 

ritfSu,^S^^'^'\[ur'^2])=T^,,, (1T5) 

and hence 

(n[:V5„JnT_^ = n[:+i5., (176) 



It follows that for any m > r' + 2, we have 



{nTJ.'Su,) n c ntfSu, = (ntV^^J n t„^,^^. (177) 



24 



Substituting flTTTj) into ffTTijl . we have 

n,,uG, = u-Lt"'-^'^ ((nr=T^5«J n • (178) 

Finally, substituting f ll78p into f ll66p . we have 

G«([J]) = U|^c[.M^i=.} (ur=r+'^ {{n-'sj n r„j) (179) 
= ur=r+^> (U{ac[.M^i=.} ((n;^i^s„J n T„J) (180) 

for any r G {r' + 1, . . . , J}. Note that for any U C [J] such that = r, the largest numerical 
value that Um can assume is J — r + m for any m G [r]. By the ordering in (11701) . for any 
m = 1 , . . . , r we have 

(181) 

= S'^^-^\[J -r + m-l])n Tj^r+m. (182) 

Substituting (11821) into (I180p completes the proof of the fact. □ 
Further note that for any r G {r' + 1, . . . , J} we have 

Tj-r+m C S^'''+^\[J -r + m])C S^''\[J - r + m - 1]) C 5("^-i)([J - r + m - 1]) (183) 
for any 2 < m < r' + 1. When r = r' + 1, substituting (I170p and (I183p into Fact [1] we have 

G^'\[J]) = l^:n=lTj-r^m = Tj = S^^'^'\[J]). (184) 

When r G {r' + 2, . . . , J}, by Fact [1] we have 

GW([J]) = Uitl {S^-'-'WJ - r + m - 1]) n T,„,+^) (185) 
y;,t\ {S^'^-'KiJ -r + m- l])n Tj^r+n.)) U 

V-'+i)([J _ r + / + 1]) n Tj„,+,,+2) (186) 

= (uit\Tj^r+m) U (5(^'+i)([J - r + r' + 1]) n (187) 

= Tj_,+,,+i U (^S^'-'+'^lJ - r + r' + 1]) n Tj„,H.,,+2) (188) 

= S'-''+^\[J - r + r' + 1]) U (^5('-'+i)([^ - r + r' + 1]) n - r + r' + 2])) 

(189) 

= ^("'+^n[^-^ + ^' + l]) (190) 

where fll87p follows from fll83p . and (11881) follows from the ordering in (11701) . Combining (11841) 
and (11901) completes the proof of (11640 for r G {r' + 1, . . . , J}. 
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Finally, substituting f ll64p into f ll62p and fll63p we have 

/(^rU^(^'+^)([r]))>5^/(^«([J]))+ f{S^'''^'\[J-r + r' + l])) 

r=l r=r'+l r=l r=r'+l 

(191) 

r' J 

= J]/(^M([J]))+ /(^^'■'""'HM)) (192) 

r=l r'=r'+l 

if / is a submodular function, and 

r' J r' J 

E f{Sryjs^^'^'\[r])) = Y,f{s^'\m+ E /(^^^''^'Hm)) (193) 

r=l r=r'+l r=l r=r'+l 

if / is a modular function. This completes the proof of Lemma [TJ 

B Proof of Lemma S 

Without loss of generality, we may assume that T = [|T|] such that tr = r for all r = 1, . . . , |T|. 
Under this assumption, the inequality (^T^ can be written as 

|T| 

J2f{Sr)+rJ{S(''\U)) 

r=l 

r, \T\ 

> J2 {fiS^''\T)) + f{Sr n 5(^)(f/))) + f^^r n {S^'^\U) U S^^^^'\[r]))). (194) 

Assume that / is a modular function. By the two-way submodularity (jl]) we have 

\T\ 
r=l 

Tq \T\ 

= Y.[f{Sr) + f{S^'\U)))+ J2 {f{Sr) + f{S^'^\U)US^'-^^'\[r])))- 

r=l r=rq+l 
\T\ 

Y f{S^'\U)US^^^+'\[r])) (195) 

r=rq+l 

> Y {fiSr n s^^Xu)) + f{Sr U S^''\U))) + 

r=l 
\T\ 

Y {fiSr n {s^'^\u) u ^(^'+^HM))) + fiSr u (^(«)(f/) u s^^^+'\[r])))) - 

r=rq+l 

\T\ 

Y fiS^'\U)US^''^-''\[r])). (196) 

r=rq+l 
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Applying Corollary |2] with r' = Vq, J = |T|, and 5*0 = S^''\U), we have 
X^/(5,U5(^)(f/))+ J2 fiSrUS^"-^+'\[r])US^'^\U)) 

r=l r=rq+l 

\T\ 

>J2fiS^"\T)US^''\U))+ J2 f{S^''''^'\[r])US^''\U)) (197) 

r=l r=rq+l 

= ^/(5M(T))+ J2 f{S^''^^'\[r])US'^'^\U)) (198) 

r=l r=rq+l 

where ffM follows from the assumption S^^'-'^T) D 5(«)(f/) such that S^'''>{T) D ^(''^(f/) for any 
r = 1, . . . , Tq. Substituting fll98p into (11961) completes the proof of (11941) and hence that of fl2T|) . 

When / is a modular function, both inequalities (11961) and (I197P hold with an equality. This 
completes the proof of (I22p and hence that of the entire corollary. 



C Proof of Corollary |4] 

Note that when Q = 0, Pqir) = 1 for all r G [\U\]. In this case, the corollary follows directly from 
(l86l) . Now, assume that Q is nonempty. Write, without loss of generality, that Q = {qi, . . . , q\Q\} 
where 



Note that 



1 =: go < gi < g2 < ■ ■ ■ < q\Q\ < \U\. (199) 



J]X5aQ(g,r)i?(jM(f/)) = 'f^ /3^(r)i?(/«(f/)) (200) 

qdQ r=l r=l 



where 



IQI 

/3Q(r) = $^«Q(gz,r) (201) 

l=m 

for any qm~i ^ r < q^ for some m G [\Q\]- When r = q^ for some m G [\Q\ — 1], by flHTl) and 
(12011) we have aq^qu t) = for any / = m, . . . , and hence 

/3qW= 0. (202) 

When qm-i < r < q^ for some m G by fl87|) and (12011) we have 

-qM = ^^S^^^3J^ (203) 
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for any I = m, . . . ,\Q\ and hence 



m \t=m t=l+l 





1) 




1) 




1) 




1) 




1) 




1) 



rm—l 



\Q\ I Q i~i 

l=m \t=m t=l+l t=m t 



1) 

{Qt - 1) 





Q 




Q 




) 




_<lt- _ 




;(gt-i) 1 




=m t 


=m 1 



where (12101) follows from the fact that 

m— 1 

by the definition ([89]) of Pqir). 



t=i 



t=m 



(204) 
(205) 

(206) 

(207) 

(208) 

(209) 
(210) 



(211) 
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By fl2Q0|) . fl202|) . and f l2T0D . the left-hand side of ({86]) can be simphfied as 



J2 R{I^'-\U)) + J2T.^Qi<l,r)R{&\U)) 

rel\U\]\Q q£Q r=l 

rel\U\]\Q r=l 



[\U\]\Q r-G[g|Q|]\Q \llt=lWt ^) / 



(212) 
(213) 



r€[\U\]\Q 
1 



\u\ 



)i?(/M(f/))+ (n(gt-i) I E ^(^^^^Hf/)) 

''"='7|Q|+l 



t=l 



(214) 



7 E /3QW^a^^^^(t^)) (215) 

llt=ll9t - 1] \r=l r=q^Q^+l J 



where ( I215P follows from the facts that Pq{t) = for all r G Q and that 



/3g(r) 



(gt-1), Vr>g|Q| + l 



(217) 



t=i 



by the definition (EH]) of /3Q(r). 

Similarly, the right-hand side of fl86|) can be simplified as 



5^ C(AW(^)) + ^^ag(g,r)C(AW([/))= _ V/3Q(r)C(AW(^)). (218 

rG[|f/|]\Q q&Q r=l [[t=l\^t ^)r=l 



Substituting (12160 and (12180 into ( !86l) and multiplying both sides of the inequality by ni=i(Q't~l) 
complete the proof of Corollary HI 
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